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ABSTRACT 

The first section of this paper is concerned with determining the 
required lower confidence limit that must be met by testing after a 
missile system becomes operational. Some of the costs of making 
decisions about the required system reliability lower confidence limit 
are discussed. Two possible cost effective models for determining 
the optimum test size are suggested. 

The second section of thJ^* paper is concerned with the effects of 
changing the number of missiles tested in each year while maintaining 
the total number of systems tests constant over the missile system's 
projected operating life. In other words, in this section, the effects 
of testing heavily in the first years versus testing heavily at the end 
of the system's life or versus testing uniformly throughout the life of 
the system are compared. For this comparison, the sum of the vari- 
ances of the estimators determined from the results of the tests con- 
ducted in each year is obtained. This value is compared for six 
representative distributions of testing throughout an estimated system 



life of ten years. 
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1. INTRODUCTION 



There are three types of tests for our current Polaris missile 
system: 

1. The Demonstration and Shakedown Operation - DASO; 

2. Operational Tests - OT ; 

3. Follow-on Operational Test - FOT. 

DASO represents the first test of the weapon system in its totality. 
For this test, the missiles are carefully prepared and then fired under 
strigent conditions. The results of DASO firings are not included in the 
data for determining the weapon system reliability. 

The OT program is a one-time test program with the specific ob- 
jective of determining weapon system reliability. It is conducted under 
the most realistic conditions possible. The system is tested in such a 
way that the entire operational system, including communications, 
authentication, navigation, and accuracy, is tested; and the observed 
success rate is computed. 

The FOT is conducted in the same manner as the OT with the 
specific objective of insuring that the weapon system reliability factor 
determined in the OT program is, in fact, still valid in the years 
following the Operational Tests. 
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This paper is concerned with determining the optimal OT and FOT 
test sample sizes. Much of the work presented here was started this 
summer at the Office of Programs Appraisal under the direction of 
Captain D. A. Paolucci. In addition, some of the ideas introduced 
come from unpublished notes of Captain Paolucci, 
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2. SUMMARY AND CONCLUSIONS 



2. 1 A Model for Maximizing the Number of Reliable Missiles in 

Inventory- 

In the final analysis, the number of missiles from a system counted 
on by the strategic planner will be determined by the number of missiles 
available and the 90 percent lower confidence limit^ for system 
reliability. In other words, if the 90 percent lower confidence limit of 
reliability is .7 and there are N missiles available, the strategic 
planner will count on . 7N when targeting the system. 

Assuming that the observed success rate is relatively constant, 
the lower confidence limit of reliability will increase every time a 
missile is successfully tested. By observing Figure 2. 1. 1, it can be 
seen that the marginal return for each test reaches a near zero point 
when the lower confidence limit comes within .11 to . 09 of the observed 
success rate. This observation might lead to the criterion that testing 
should continue until the lower confidence limit of reliability is within 
. 11 to . 09 of the observed success rate. 

It can be shown, see section 3. 1, that using this criterion for 
determining test sizes can, under certain circumstances, result in a 

^To avoid messy notation and confusing the problem, this 
paper will always use the 90 percent confidence level. This choice of 
90 percent is completely arbitrary and may not necessarily reflect 
Navy policy. 
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FIGURE 2. 1. 1 



smaller number of reliable missiles counted on by the targeter than 
would be counted on if fewer missiles were tested. 

For this reason, the following alternate model for determining the 
required test size to estimate missile system reliability is suggested. 
Choose n to maximize Q in the following expression. 

Q - L(M - n) , where: 

L = the 90 percent lower confidence limit determined 
by n and the observed success rate; 

M - the total number of missiles purchased; 

n = the number of trials. 

Using this criterion to determine the test size results in testing 
about 33 missiles if the observed success rate is in the area of . 7 to 
.9. ^ The criterion mentioned earlier requires approximately 35, 46, 
and 49 missiles for observed success rates of . 9, .8, . 7, respectively. 

A cost effective model for determining the test size to most 
effectively increase the reliable yield of the expected number of missiles 
deployed is presented in section 3. 2. This model uses the marginal 
cost of increasing the expected yield of the Polaris missile system by 
procurement as the cut-off point for spending on missile testing. 

The cost information necessary to obtain an explicit number for 
test size using this model is not known to the author. Therefore, no 

^See section 3. 1 for mathematical justification of this 
statement. 
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further discussion of this model will be presented in this section except 
to note that the figures necessary to obtain an explicit solution are 
obtainable. 
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2. 2 Brief of Method Used in Investigating Models One, Two, and Three 

The present doctrine used to determine FOT test sizes is to use 
the same size test that is necessary for the OT. Therefore, for the 
next ten years somewhere between 300 and 400 missiles would be 
programmed for expenditure during OT's and FOT's. 

To investigate some of the effects on reliability estimation by 
changing the yearly FOT test size, six different sample plans that 
distribute the testing throughout the years in different ways were con- 
sidered. These sample plans are given in Table 2. 2. 1. 

To avoid confusion in this section, all testing done in year i will 
be designated as test i; and the individual shots will be designated as 
trials. Each different way of distributing the tests among the years 
will be called a sample plan. 

To compare the different sample plans, the sum of the variances 
computed in each year will be obtained for each sample plan. In other 
words, the variance of the estimator of reliability will be obtained 
under a sample plan for year one. Then, using the same sample plan, 
the variance of the reliability estimator will be obtained for years 
two through ten. Once these values have been obtained, the ten of them 
will be added together and the sum will be called the sum of the 
variances. 

The reason for the criterion of comparing the sum of the variances 
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Sample 

PlanNo. Year 1 Year 2 Year 3 Year4 Year 5 Year 6 Year? Year 8 Year9 Year 10 
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YEARLY TRIALS IN SAMPLE PLANS ONE THROUGH SIX 



can be likened to the quest for a 'minimum variance estimator" in 
many conventional estimation problems. 

The sum of the variances depends on the different test sizes, the 
initial reliability (Pq)» a-nd the total number of missiles tested in the 
ten years. An attempt has been made to investigate the different sample 
plans over a plausible range of values for p^ and N, the number of 
missiles scheduled for testing during the first ten years of operational 
life. To this end, the sum of the variances for each sample plan is 
computed using all possible combinations of , 7, .8, .9 for p^, and 200, 
300, and 400 for N. 

Perhaps a little more explanation is merited here. Assume that the 
sum of the variances of sample plan one is being computed. Now look 
at the situation where p^ = . 7 and N = 200. When N = 200, sample 
plan one requires that 20 trials of the system be conducted in the first 
year. From this, an expression for the variance of the estimator can 
be obtained. Likewise, an expression for the variance of the estimator 
in years two through ten can be obtained. Once the variances for all 
the years have been obtained, they are added together and the number 
is recorded as the sum of the variances under sample plan one, where 
p^ = . 7 and N = 200. Next, sample plan two will be used; and the 
sum of the variances under this sample plan, when p^ = . 7 and N = 200, 
will be obtained. 
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We will continue in this fashion until the sum of the variances 



when Pq = . 7 and N = 200 have been determined for sample plans one 
through six. Then, the next combination of p^ and N, say p^ = . 7, 

N = 300, will be considered. In the same manner as before, the sum 
of the variances for all the sample plans will be obtained. The compu- 
tations will continue until the sum of the variances for each sample 
plan has been obtained for all possible combinations of the three values 
of Pq and N. Having obtained these variances, those sampling plans 
with the associated smaller variance values would be superior to those 
with larger variances from the point of view of having accurate esti- 
mates of missile reliability. 
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2. 3 Determining FOT Sample Size Using Model One 



Consider a collection of N missiles that are characterized by life- 
times X, , , ... , X where X represents the time from initial 

12 N 1 

inspection and release until the i^^ item deteriorates to an unacceptable 
state. If it is assumed that the initial states of the missiles are the 
same, then the X.'s are non-negative independent, identically distributed 
random variables. Suppose that there are ten distinct times that ob- 
servations are to be taken from the collection of missiles. Also, assume 

that K. items are to be observed at time t. . These observations can be 
1 1 

summarized by the random variables Y , Y , ... , Y where: 

12 K. 



On the basis of this information, it is desired to estimate R(t. ) , 

J 

P (a missile's lifetime is greater than t. ) , for each t. = j , 
j = 1 , 2, ... , 10 . The estimation procedure which is proposed has 

the following form. For each j , the estimate of R(t. ) is given by 



1 




1 if the missile system fails 
0 if the missile system is successful 
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where: 



1 



n 



0 



0 , n. = L K , n. 1, 2, . . . , 10 
1 . , r 1 



K = no. of trials in year r 




1 if test i fails 



0 if trial i is successful 



This estimator provides continuity to the estimates of reliability 
over the ten years, see section 3. 3. However, this estimate is 
generally more optimistic in the early years and more pessimistic in 
the out years than the Maximum Likelihood Estimator. The MLE 
mentioned here is the MLE of reliability using only the information 
obtained from the current test. Note that Model One does take past 
data into account. 

To investigate Model One, it was assumed that the probability of 
a successful trial at any given time t could be expressed by the expo- 
nential function: 



The sum of the variances was then computed for all combinations of 



for values of b ranging from . 002 to . 2. The results of these compu- 
tations are displayed in the graphs on pages 20 through 37. 

On these graphs, values of b are plotted along the abscissa, and 
values of the sum of the variances are plotted along the ordinate. 



P(t) = p^e 



-bt 



where b is an unknown parameter. 



pQ and N, as explained before. In addition, these values were computed 



16 



The grid superimposed on each graph is a one-inch square grid. The 

scale of the abscissa, x scale, the scale of the ordinate, Y-SCALE, 

the initial reliability, P(0), and the total number of trials in ten 

years, N, are lettered at the bottom of each graph. These values are 

written in powers of ten. The number directly next to the letter E is 

the power of ten by which the main number is to be multiplied. For 

example, the number 5. OOE-01 is read as 5, 0 x 10 ^ or . 5. The 

2 

number 2. OOE+02 is read as 2. 0 x 10 or 200. The numbers just to 
the right of each plot designates the sample plan that was used to obtain 
the plot. Suppose the sum of the variances for sample plan one is 
desired when p^ = . 7, N = 200, and b = . 1. The graph for this case is 
found on page 20. The value desired can be read off the curve labeled 1. 
Similarly, the sum of the variances for sample plan six with the same 
parameters can be read from the curve labeled 6. To insure that the 
reader has found the proper values, these values have been marked 
with an x. The graphs are filed in the following order: all combinations 

of N with p^ = . 7, then all combinations of N with p^ = . 8, and then 
all values of N with p^ = .9. 

From reading these graphs, it can be seen that for all values of 
the parameters sample plan six and four have the smallest sum of the 
variances. The rest of the sample plans range from next smallest to 
largest value of the sum of the variances in the following order: 
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three, one, two, five. For ease in understanding the results, the table 
explaining the yearly test sizes for each sample plan is reproduced on 
the following page. 

These results indicate that if 200 missiles were programmed for 
Follow on Testing in the next ten years there may be some merit to 
distributing the testing as shown below. 

Suggested allocation per year of FOT testing 

if a total of 200 trials are to be conducted: 

Year one -- 60 trials; 

Years two through six -- 20 trials; 

Years seven through ten -- 10 trials. 

These figures are obtained using sample plan four. 
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Sample 

Plan No. Year 1 Year 2 Year 3 Year 4 Year 5 Year 6 Year 7 Year 8 Year9 Year 10 
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YEARLY TRIALS IN SAMPLE PLANS ONE THROUGH SIX 
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2.4 Determining FOT Test Sizes Using Model Two 

Model two uses the following expression for reliability at any 
time t: 

R (t) = - Be^^ t > 0 

where: 

p^ = initial reliability; 

B = a known constant; 

c = an unknown parameter. 

Notice that this expression assumes an exponential decay of reliability 
as time increases. The factor B is chosen so that R(t) is always non- 
negative. The graph of e^ for positive x starts at a value of one and 
is monotonically increasing as x increases, see figure 2. 4. 2. 

If a scaling factor was not used in the expression for reliability, then 
negative values would be obtained. Arbitrarily, a scaling factor of 
B = . 01 was used. This merely displaces the curve of the second term 
in the expression downward, see figure 2. 4. 2. 

To investigate Model Two, a Maximum Likelihood Estimator for 
reliability was obtained. Then, the expression for the variance of this 
estimator was determined, see section 3. 4, The sum of the variances 
was then computed for all combinations of p^ and N, as explained in 
section 2. 2. In addition, these values of the sum of the variances were 
computed for values of c ranging from . 00424 to . 424. Note that if 
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larger values of c were allowed, R(t) would be negative when t = 10. 
Therefore, c has been varied over its entire range of plausible values. 

The results of the computations of the sum of the variances are 
displayed on the graphs on pages 4Z through 59. The abscissa of these 
graphs represents values of c. The ordinate of these graphs represents 
values of the sum of the variances. See page 17 for an explanation of 
how to read these graphs. 

By examining these graphs, it can be seen that the sample plan 
that gives the minimum sum of the variances for all combinations of 
p^ and N is sample plan six. The value of the sum of the variances 
then increases for the sample plans in the following order: plan four, 

plan three, plan one, plan five, and then plan two. 

For convenience in understanding these results, the table explaining 
the yearly test sizes for each sample plan is reproduced on the following 
page. Notice that as in the first model the sum of the variances is less 
for the plans that call for heavy testing in the early years. The plans 
that call for heavy testing in the out years result in the largest values 
of the sum of the variances. 
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YEARLY TRIALS IN SAMPLE PLANS ONE THROUGH SIX 
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FIGURE 2. 4. 2 
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2. 5 Determining FOT Sample Size Using Model Three 



Model Three uses the following model for reliability at any time t: 



This linear model was chosen so that the more complex models one and 
two might be compared with a simple and familiar model. 

To investigate this model, a maximum likelihood estimator for 
reliability was obtained. Next, an expression for the variance of this 
estirtiator was determined, see section 3. 5. Using the method outlined 
in section 2. 2, the sum of the variances was then computed as a function 
of a for all combinations of p^ and N. The values of the sum of the 
variances were then determined for a range of values of a between 0 



sum of the variances has been computed for the entire range of plausible 
values of a. 

The results of the computations of the sum of the variances are 
displayed on the graphs on pages 63 through 80. The abscissa of the 
graph represents values of a and the ordinate represents values of the 
sum of the variances. See page 17 for an explanation of how to read 
these graphs. 



R(t) = Pq - at 



where: 



p^ = the initial reliability; 
a = an unknown parameter. 




At this point, R(10) becomes negative; therefore, the 
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By examining these graphs, it can be seen that the sample plan 
that gives the minimum sum of the variances for all combinations of 
Pq> N, and values of a is sample plan six. The value of the sum of the 
variances increases for each sample plan in the following order: 
plan four, plan three, plan one, plan five, and then plan two. 

For convenience, a table explaining the size of each yearly test 
under the different sample plans is presented on the following page. 
Notice that as in the first two models the minimum sum of the variances 
occurs for the plans that test heavily in the early years and moderately 
in the out years. The plans that call for heavy testing in the out years 
have the largest values of the sum of the variances. 
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SUM OF VARIANCES VERSUS a 
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2. 6 Comparison of Models One, Two, and Three 

The sum of the variances for all three models was minimum for 
sample plan six. Sample plan six calls for extremely heavy testing in 
the early years and very little testing in the out years. Sample plan 
four results in values of the sum of the variances that are next 
smallest to the values for plan six. However, plan four is very 
similar to plan six. Note that plan three also calls for heavy testing 
in the early years and moderate testing in the out years. Sample plan 
three is different from plans four and six in that the testing in the 
early years, although heavy, is more moderate than that called for 
in the early years by plan six or four. The testing required in the out 
years by plans four and three is moderate. However, the scheduled 
testing is not as moderate as for sample plan six. For all cases, i. e. , 
all models and values of the unknown parameters, the sample plans that 
call for moderate testing in the early years and heavy testing in the out 
years (plans two and five) result in values of the sum of the variances 
that are a maximum. 

Testing heavily in the early years rather than testing uniformly 
throughout the years or testing heavily in the out years has some 
appeal to the practical. Since missile systems are programmed for 
an operational life of about ten years, planners might be reluctant to 
launch any large correction program determined necessary by testing 
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in the out years. Rather than spending money on a retiring system 
the planners might prefer to spend the money speeding up the phase 
in of the successor system. However, efforts along this line are 
usually not successful and in all likelihood an unsuspected discrepancy 
in a missile system that shows up in the out years will not be 
corrected. 

Heavy testing conducted in the early years will allow for much 
higher confidence in the predictions of reliability for the out years. 
From these predictions, a potential discrepancy in the system that 
might not be noticed until the out years under other sample plans may 
be uncovered early in the system's life. Because of this, corrective 
action can be taken while time is available and planners are more 
willing to invest in the system. 
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FIGURE 3. 1. 1 
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3. ANALYSIS AND DISCUSSION 



3. 1 Mathematical Support of the Inventory Model 

In the final analysis, the number of missiles from a system counted 
on by the strategic planner will be determined by the number of missiles 
available and the 90 percent lower confidence limit for system 
reliability. In other words, if the 90 percent lower confidence limit 
of reliability is . 7 and there are 200 missiles available, the strategic 
planner will count on . 7 (200) = 140 missiles. 

When conducting an OT or FOT of a missile system, a missile is 
fired under the most realistic conditions attainable in peacetime and the 
impact of the missile on the test range is monitored to determine if 
the missile firing obtained the desired results. Whenever a missile is 
tested, the lower confidence limit of reliability comes a little closer 
to the observed success rate. ^ In fact, if all the available missiles 
were tested, then the lower confidence limit for reliability would be the 
observed success rate. A plot of the 90 percent lower confidence limit 
versus the number tested for observed success rates of . 7, . 8, and .9 
is shown in Figure 3. 1. 1. 

The crux of determining the number of missiles to test is depicted 
here. Obviously, we want the lower confidence limit of reliability to 

The observed success rate is merely the number of successful 
firings divided by the total number of firings. 



84 



be close to the real reliability of the system. However, to make the 
lower confidence limit for system reliability the same as true system 
reliability, we must test all the missiles. Certainly this is not the 
solution. The problem of where to stop testing could be solved by 
observing the graphs in Figure 3. 1. 1 and noting that one is beyond 
the "knee” of the curve if testing is conducted until the lower confi- 
dence limit is within about . 1 or . 09 of the observed success rate. 

Let us investigate just what effect a criterion such as this will 
have on a 4^ixed inventory of missiles. In this discussion, the following 
common notation will be used: 

M = the total number of missiles in inventory; 

n = the size of the test; 

L = the 90 percent lower confidence limit for reliability. 

This number is determined by the size of the test 
and the observed success rate. 

Assume that M is 200 and that the observed success rate of the missiles 
tested is running in the vicinity of . 8. To satisfy the criterion that the 
lower confidence limit for reliability be within . 09 of the observed 
success rate, i. e. , ,71, will require approximately 50 tests and the 
strategic planner will use (200-50) . 71 = 106 as the expected number of 

^The "knee" of the curve is a term used commonly by some 
economists and is loosely defined as the point on the curve where the 
marginal increase in utility per resource expenditure is relatively low. 
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VALUE OF L(M - n) VERSUS n 
FIGURE 3. 1.2 ' 
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reliable missiles. However, if, under the same circumstances (i, e., 
observed success rate of . 8) the system was tested only 30 times, the 
lower confidence limit for reliability would be .67 5 and the strategic 
planner could count on . 675(200-30) = 114 as the expected number of 
reliable missiles. Not only is this a gain in the expected number of 
reliable missiles in inventory, but it is also a monetary gain of the cost 
of testing 20 missiles. Perhaps one more such excursion will illumi- 
nate more fully the costs of the criterion outlined above. Assume that 
M is 150 and the observed success rate is running about .7. To satisfy 
the criterion that testing be continued until the 90 percent lower confi- 
dence limit on reliability is within . 1 of the observed success rate, 
i. e. , a lower confidence limit of . 6, will require 50 tests and the 
strategic planner will count on . 6(150-50) = 60 as the expected number 
of reliable missiles. Under the same circumstances, if only 30 
missiles had been tested, the lower confidence limit for reliability 
would be . 565 and the strategic planner would count on . 565(150-30) 

= 68 missiles. Again this is a savings of eight more missiles in the 
expected number of reliable missiles in inventory and the cost of 
testing 20 additional missiles. 

For the reasons noted in the last paragraph, an alternate criterion 
for determining the number of missiles to test might be to choose n to 
maximize the quantity Q in the following expression. 

Q = L(M - n) 
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Notice that when n is zero, L. is zero, and therefore Q is zero. 

Whenever n is between zero and M, Q is positive. Since Q is zero when 
n equals M, we know that Q has a maximum value for some values of 
n in the interval 0 - M. In an effort to show that many complex 
problems do not require extensive and high-powered mathematics, the 
value of n that maximizes Q has been solved graphically. 

By using semi-log paper and using values of L«(M - n) as ordinates 
versus values of n along the abscissa, a plot of the values of Q for 
various success rates and values of M can be obtained. This graph 
is shown in Figure 3. 1.2. Plots of the value of Q for all combinations 
of M = 50, 100, 200, and 400 and success rates of . 5, .6, .7, .8, .9 
are displayed. Notice that for values of M greater than 100 the value 
of n that universally maximizes Q is from 33 to 38 missiles. Thus, 
even though the success rates will be unknown prior to experimentation, 
it so happens that the optimum sample size n is basically a function only 
of M and the confidence level. (This can be seen from Figure 3. 1.2.) 
Consequently, the following procedure can be implemented. This 
procedure is that for M between 200 and 400 and success rates greater 
than . 5, the test size should be 33. For information, a table demon- 
strating the small increase in the 90 percent lower confidence limit 
for variations in test size about this "optimal" number is shown on the 
following page. 
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ONE-SIDED 90 PERCENT CONFIDENCE LIMITS 



3. Z Description of Missiles Deployed Model 

One problem with the model presented in the first section is that 
we can not expect to use all of the missiles in inventory. More than 
likely the Polaris system will use only the missiles that are already 
deployed at the outbreak of the exchange. 

An appealing model that could be used to determine the optimal 
test size, considering only use from deployed missiles, can be con- 
structed if it is assumed that our defense resources have been allocated 
in a near optimal manner. In other words, money was spent on the 
Polaris program until the cost of increasing our defense posture 
through Polaris was more than the cost of increasing our defense 
posture by an equal amount using another system. Realize now that 
testing a system merely allows us to count on a larger number of re- 
liable missiles. ^ The expected number of reliable missiles can also 
be increased by procuring a larger number of systems. The cost of 
increasing the expected number of reliable missiles through procure- 
ment is called the marginal cost of reliable missiles through procure- 
ment. The marginal cost of increasing the expected number of reliable 
missiles through testing can be computed using the following formula. 

Of course, if, on subsequent testing, the observed success rate 
was lower, the expected number of reliable missiles used by the 
planner could conceivably be lower in this case. In this exposition, we 
are assuming that success rate is nearly constant. 
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MC 



AL(N) / C 



where: 

MC = The marginal cost of increasing the expected 
number of reliable missiles through testing. 

A Li = The increase in the 90 percent lower confidence 
limit for reliability caused by the last test of the 
system. 

N = The average number of missiles deployed at any 
time. 

C = The cost of testing the missile. 

Now testing should be conducted until the marginal cost of increasing 
the expected number of reliable missiles through testing is equal to 
the marginal cost of increasing the expected number of reliable missiles 
through procurement. 

An immediate argument against this model is that to increase the 
number of reliable missiles through procurement would require a new 
submarine. This is an extremely costly process and would therefore 
lead to excessive missile testing if the above criterion was established. 
However, the dilemma can be resolved by considering the marginal 
cost of increasing the yield over the target by any system that com- 
petes with Polaris. The lowest cost in this group should be used in 
place of the marginal cost for Polaris. Thus, one could say that 
testing will stop whenever the cost of increasing the expected yield of 

Wield is introduced here merely to have a common ratio between 
Polaris and the systems competing with Polaris. 
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the Polaris system from testing equals the cost of increasing the ex- 
pected yield of any competing system through procurement. In this 
case, MC would be computed as follows: 

MC = AL(N)(Y)/C 
where Y is the yield from a Polaris missile. 

An explicit solution for n is not included here because the marginal 
cost of procurement for Polaris and the systems competing with 
Polaris is not known to the author. However, these figures have been 
computed; and once they are used, an explicit value for optimal n 
follows immediately. 
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3. 3 Mathematical Support of Model One 

Consider a collection of N missiles that are characterized by 

lifetimes X, , X_ , ... , X where X. represents the time from initial 
1 Z n 1 

inspection and release until the i^^ item deteriorates to an unacceptable 
state. If it is assumed that the initial states of the missiles are the 
same, then the X^'s are non-negative independent, identically distributed 
random variables. Suppose that there are ten distinct times that ob- 
servations are to be taken from the collection of missiles. Also, 

assume that K. items are to be observed at time t. . These observa- 
1 1 

tions can be summarized by the random variables Y , Y , Y , . . . , Y 

1 Z j K . 

1 

where : 



On the basis of this information, it is desired to estimate R(t), P 
(a missile's lifetime is greater than t). The estimation procedure 
which is proposed is of the following form. For each time t, the 
estimate of R(t) is given by 




1 if the missile system fails 
0 if the missile system is successful 



n. 



t 



1 

i; 

K=(ni_ 1 + 1) 



n N - n. ^ 
, 1-1 



Y 



K 



R(t) = 



N(N - n^)(N - n^) . . . (N - ^ 



where: 



n 



0 



0 
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where: 



n, = L K , i=l,2,..,,10 

^ r=l ^ 

K = no. of trials in year r 
r 

From this, it is obtained at once that: 



n [N-n , - K (1 - p )] 

^ ^ ^ ^ i=l * 

" NIN-n^HN-n^)... (N-n^_^) 

n [(N-n )^-2(N-n ) K (1 -p ) 

Z 1=1 1-1 1-11 1 

R(t) ] = ^ 

[NIN-n^HN-n^)... (N-n^_j)] 

+ K.p.(l -p.) + K.^l -p.)^] 



and the variance of the estimator is given by 

Var R(t) = E[R(t)^] - [E[R(t>] f 
Note that Model One can be defined as: 

no. of failures in the t^^ test H 

N — no. of missiles tested prior to time t J 

By considering numerous different possible results of testing, it was 

observed that this estimator tends to be more conservative than the 

Maximum Likelihood Estimator of reliability in the early years. In 

the out years, this estimator tends to be pessimistic. In addition to 

the above properties, this estimate lends continuity to the estimates of 

reliability. The excursions listed on the next page illustrate these points. 



R(t) = [R(t-l)] [l 
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Excursion 1 : 



N = 100 , K. = 10 , for all i , There are two failures in each test. 



Y ear 



Model 



One Estimate 



MLE* 









100 - 2 




10 


1 


R(t^) 


- 


= .98 

100 


R(tj) 










2 






z 


R(t2) 




.98(1 -— ) = .956 


R(V 


= . 8 








2 






3 


R(t3> 




.956(1 --) = . 932 


R(t3) 


= .8 








2 






4 


R<V 




.932 (1 -_)=.904 


R(t4> 


= . 8 








2 






5 


R(t5> 


- 


.904(1 . 874 


R(‘5> 


= . 8 








2 






6 


R(t^) 


= 


.874(1 ) = .837 


R(t6> 


= . 8 








2 






7 


R(t^) 


= 


.337( 1 -— ) = . 795 


R(t.^) 


= . 3 








2 






8 


R(tg) 


= 


. 795(1 . 741 


R(tg) 


= . 8 


9 


Ritg) 


= 


.741(1-A) = ,667 


R(tg) 


= . 8 


10 






.667(1 - j|)=. 532 




= . 8 



10 



= . 8 



^ Estimate of Reliability using only the yearly test information. 
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Excursion 2 : 



N = 100 , K. = 10 , for all i . 

1 

Year 123456789 

EY 312142031 

i 

Note that the average number of failures per year is two. 
Year Model One Estimate MLE^' 



1 


R(tj) = 


100 - 3 
100 


= .97 




R(tj) 


2 


= 


.99 (1 


- — ) = 
90 ' 


.979 


R(V 


3 


R(t3> = 


.979 (1 


II 

1 


. 954 


R(tj) 


4 


R(V = 


.954 (1 


- 4 > = 


.94 


R(t4> 


5 


R(t5> = 


.94 (1 


1 

II 


. 88 


R(V 


6 


R(V = 


.88 (1 


1 

o| 

II 


. 835 


R(V 


7 


R(t^) = 


. 835 






R(t^) 


8 


R(tg) - 


. 835 (1 


II 

1 


. 752 


i(tg) 


9 


Rdg) = 


. 752 (1 


--) = 
20 ' 


. 713 


R(tg) 


10 


II 


. 713 (1 




. 5 





Estimate of Reliability using only the yearly test information. 
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3 
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8 
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8 

0 

7 
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Excursion 3: 



N = 200 



Year 


1 


2 


3 4 


5 


6 


7 


8 


9 


10 


K 


60 


20 


20 20 


20 


20 


10 


10 


10 


10 


27Y. 

1 


9 


3 


4 3 


2 


5 


0 


3 


4 


4 


Year 




Model One Estimate 






MLE* 




1 




R(tj) 


200 -9 
200 


= .955 






R(tj) 


= . 85 




2 




R(t2> 


= .955 (1 


" l40 ^ " 


.933 




R(V 


= . 85 




3 




RItj) 


= .933 (1 


II 

(M 

1 


. 89 7 




RItj) 


= . 8 




4 




R(V 


= . 897 (1 


100 ' 


. 87 




R(t^) 


= .85 




5 




R(t^) 


= .87 (1 


II 


. 847 




RItg) 


= .9 




6 




R(V 


= . 847 (1 


■el' = 


. 725 




R(t^) 


= . 75 




7 




R(t^) 


= . 725 








R(t^) 


= 1.0 




8 




R(tg) 


= . 725 (1 


•tI' - 


. 652 




R(tg) 


= . 7 




9 




Ritg) 


= . 652 (1 


•H> - 


. 522 




Rftg) 


= . 6 




10 




R(tio> 


= . 652 (1 


■w' ■ 


. 39 




R(tjo) 


= . 6 





Estimate of Reliability using only the yearly test information. 



97 




GRAPH OF VERSUS x 
FIGURE 3. 4. 1 
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3. 4 Mathematical Support of Model Two 

The exponential decay model has been used on numerous occasions 
to describe reliability decay of electronic systems. To this end, 

Model Two introduces an exponential decay. However, to avoid the 
rapid decrease of reliability in the first years that ensues using the 
exponential decay form R(t) = p^ e , the following expression for 
reliability is introduced: 

R(t) = pp - Be^‘ 

where: 

p^ = the system's initial reliability; 

B = a known constant; 

c = an unknown parameter; 

t = time, i. e. , 1, 2, ... ,10. 
ct 

Figure 3.4. 1 illustrates that e is greater than or equal to one for 
all positive values of c and t. Therefore, if a value of B that is greater 
than or equal to one is chosen, negative values of reliability will result. 
To avoid this, B has been arbitrarily set equal to .01. This value 
merely displaces downward the value of the second term in this ex- 
pression. With this value of B, the expression for reliability will be 
positive for all combinations of t from zero to ten and c from . 00424 to 
.424. 

Because of the invariance principle, we may obtain an estimator 
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for c , call it c ; and then the estimate for reliability can be obtained 

by substituting c for c. We will, therefore, assume that is known 

and obtain a Maximum Likelihood Estimator for c. As a reminder, 

all testing done in year i is designated as test i. Each individual firing 

of a missile is called a trial. K. is the number of trials in the i^^ test, 

1 

and s. is the number of successful trials in test i. 

1 

The MLE is obtained in the following manner. The probability that 

th 

s successes are observed during the i test can be expressed by: 

K- K. - s 

P [no. of successes = s] = (g^) (R(t))^ (1 - R(t)) ^ 

= (^i) (pg - 66*=^® (1 - Po + 

Let L(c) = P [no. of successes = s]. Then 



In L(c) = In (s M + s In (p^ - Be^^ ) + (K. - s) In (1 - Pq + Be^^) 



a In L(c) 



ac 



-stBe^^^ (K. - s) (tBe^^) 

T. ct , „ ct 

Pq - Be 1 -p^+ Be 



To obtain a Maximum Likelihood Estimator of c, set this equation equal 
to zero. The solution to this equation is c . Doing this yields 



» 1 , 

" = T - k.B 



expanding in a Taylor series 



100 



l=i 




J t 


t B L 



P; 



= - In — 
t B 



-- P 

‘ tp„ 



- 2 

2pJ 



. 3 



3P. 




r 

— ^ eTs.^ 1 . Now s is a binomial 
1 

random variable with parameters and . The method of obtaining 
the expected values of the powers of s using factorial moments is 
illustrated in Appendix 1. 

Using these values, the mean and variance of the estimator for c 
may be approximated from the following expressions. 



Now since p^ = — — then Ej^p.^ J = 



K. 



1 

R(t). 



For ease in writing these long equations, 



p. has been used for 
1 
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2K. 

i ^0 



3K. p^ 
1 ^0 



|-TE[s.3]+ ... } 



_ 1 1 0 1 r 1 ^ 

- " B - t. {k.p^ iPi 



■ +-4-^[K.(K.-l)p.^K.p.] 

Po 



+ -4-^ [K.(K.-1)(K. -2)p.' 

Po 



3 (K. (K. - 1) p.^ + K.p.) - 2 (K.p.)] +...). 



r^r-'2, .1 (-, 2 Pq , Pq r 1 T^r . , 1 ,-r 2. 

E[c. ]=^|ln _ . 2 In - E[s.] + — ^ E[s. ] 

f 1 0 /■ K -t-w 



Po 



1 3 n 1 2 ^ 

" 3 J J + -2-^ J 

Po Po 



+ \ T E[s.^] + E[s.'*] 

^3 3 “-1-J 19T.4 4 “-1^ 

Ki Pq 12K. Pq 



1 ^0 



E[s 






’«! Po 



102 



1 



1 0 



" — ^ [K.(K.-1)P.^+ K.P.] 

Po 



+ — 3-3 [K.(K. - 1)(K. -2)p.^ + 3[K.(K.-l)p." + K.p.] 

Po 



- 2K. p. 1 + ... 
1 



+ -f-T (K.(K. .l)p.^K.pp 

Po 



+ [K.(K.-1)(K. -2)p,' 

Po 

+ 3 [K. (K. - 1) p^ + K. p.] - 2K.p. ] 

‘-1 1 l l -* 1 ^ 1 -^ 

+ {K (K - 1) (K - 2) (K - 3)p^ 

12K. 

1 ^0 

+ 6 [K. (K. - 1) (K. - 2) p.^ + 3[K. (K. - 1) p.^|+ K. p. ] 

- 2K.p. ] - 11 [K. (K. - 1) p.^ ] 

+ 6K,p, ] + . . . ■} 

Var [c,^] = E[c.^] - E^[c.] 
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3. 5 Mathematical Support of Model Three 

Models One and Two involve fairly complicated expressions for 
R(t) . It might be illuminating to compare these more complicated 
models with a simple linear model. Therefore, the following expression 
for reliability is proposed. 



A Maximum Likelihood Estimator for a will, by the invariance 
principle, result in a Maximum Likelihood Estimator for reliability. 
The MLE of a is found in the following manner. The probability that 



R(t) = Pq - at 



where: 



p^ = the initial reliability of the system; 



a 



= an unknown parameter; 



t = time, i. e. , 1, 2, ... ,10. 



s successes are observed in K. trials can be expressed as: 



P[Si = s] = (Ki) (R(t))® (1 - R(t) ) ‘ 



K. - s 



1 



(?i) (Pq - at)® (1 - Pq + at) 



K. - s 



1 



Calling this expression L(a) and taking logs: 



In L(a) = In (gi) + s In (p^ - at) + (K. - s) In (1 - Pq + at) 



and 



3 In L(a) 



St (K. - s) t 



a a 
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Setting this expression equal to zero and solving for a gives 



and 



K. - 
1 ^0 

K. t 
1 



K. t. 
1 1 



E [ a ] = a Var [ a ] = 



K.t 



2 <Pq ■ - Po + 



follows directly from the expression for a . 
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APPENDIX I 



FACTORIAL MOMENTS OF A BINOMIAL RANDOM VARIABLE 



The moments of a binomial random variable, s , may be generated 
using the probability generating function 

M^ (z) = (q + pz)^ 

where K indicates the number of trials and 

q = 1 - P • 

For simplicity in notation, let 



and 



Now 



G = M (z) 
s 



Trr 

E [s ] = s 



S_G 



K - 1 



^ j = K(q + pz) P 2 = 1 = Kp 



2 

dz 



z = 1 



= K (K - 1) (q + pz) p 



z = 1 



= K (K - 1) p 



Since the term (q + pz) will always reduce to one when z is set 
equal to one, we see a recursion relation, namely: 



5 G 



dz 



= K(K - 1) . . . (K - (n + 1)) p" 
z=l 
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We may now deduce that: 



E[s(s-l)...(s-(n+l))] = K(K-l)...(K-(n+l))p" . 
Proceeding from here, the expected values are determined below, 

E [s (s - 1) (s - 2)] = K(K - 1) (K - 2) 

_ 3 2 3 

s - 3s + 2s = K (K - 1)(K - 2)p 

s ^ = K (K - 1) (K - 2)p^ + 3s^ - 2s 

E[s (s - l)(s - 2)(s - 3)] = K(K - 1)(K - 2)(K - 3) p^ 
s‘*-6s^+lls^-6s=K(K-l)(K-2)(K-3)p‘^ 
s^ = K(K-1)(K-2)(K-3 )p^+6s^-11s^+6s 

E[s(s - l)(s - 2)(s - 3)(s - 4)] = K(K - 1)(K - 2)(K - 3)(K - p^ 
s^ - 101“^ + 35s^ - 50s^ + 24s = K(K - 1)(K - 2) (K - 3)(K - 4)p^ 
s^ = K(K-l)(K-2)(K-4)p^+10s^-35s^ + 50s^ - 24 s 

E[s(s - l)(s - 2)(s - 3)(s - 4)] = K(K - 1)(K - 2) (K - 3){K - 4) (K - 5)p^ 
s^ - 15s^ + 85s^- 225s^ + 274 s^ -120s 

= K(K - 1)(K - 2)(K - 3)(K - 4)(K - 5) p^ 
s^ = K(K - 1) (K - 2) (K - 3) (K - 4) (K - 5) p^ 

+ 15s^-85s‘*+ 225s^ - 274 s^+ 120 s 
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APPENDIX II 
COMPUTER PROGRAMS 



01 21 66 



DIMENSION P(10,3 ),EP(11) tEPP( 1 1 ) »EPS(11 ) 

C0MM0N/VAR1/AK( 10,6) 

00 1 J=l,3 / 

GO TO ( 18,9,1 10) ,J 
18 AN=200 $ GO TO 101 

9 AN=300 S GO TO 101 
1 10 AN = U00 $ GO TO 101 

101 DO 1 JM=1,3 i 
GO TO (2,3,4) , JM 

2 AL=.01 $ GO TO 5 

3 AL=,1 $ GO TO 5 

4 AL=.2 $ GO Tp 5 

5 DO 6 JN=1 , 10 

6 P( JN, JM)=EXPF (-AL*JN) 

CALL SAMPLE (AN) 

DO 1 J0=l,6 
DO 8 JP=1 ,10 
M=JP-1 

IF(JP-l) 10,11,10 

11 EP(1)=( (AN-AK(1, J0)*(1.-P(1, JM)))/AN) i 

EPS(l) =EP(1)**2 
SUM = 0 

EPP( 1 ) =(AN**2-2 .*AN*AK( 1 , JO ) * ( 1 .-P ( 1 , JM ) ) +AK( 1 , JO ) *P ( 1 , J M ) ♦( 1 . -P ( 
1 1 , JM) )-M AK( 1, JO)* (l.-P(l , JM) ) )**2)/AN**2 
SVAR =EPP( 1 )-EPS (1 ) 

PRINT 1002, EP(l), EPPd )iS\/AR,AK(l,JO),P(l,JM) 

1002 FORMAT( lOX, E16.9,10X, £16.9, lOX, E 1 6 . 9 , 1 OX, F4 . 0 , 1 OX , E9 . 8// / ) 

GO TO 8 

10 SUM=SUM+AK( M, JO) 

EP(JP) = EP(M)*(AN-SUM-AK(JP,J0)*(1.-P(JP,JM)))/(AN-SUM) 

EPS(JP) =EP(JP)**2 

EPP(JP) = EPP(M)*( (AN-SUM)**2-2.*( AN-SUM)*AK( JP, J0)*( 1 .-P( JP, JM) ) 

1 +AK( JP, JO)*P( JP, JM)* ( 1 .-P ( JP, JM) )+( AK( JP, JO)* ( 1 .-P( JP, JM) ) )**2) / 

2 ( AN-SUM)**2 

SVAR=SVAR + EPP(JP)- EPS(JP) 

PRINT 1004, EP(JP), EPP(JP), SVAR, AK ( J P , JO ) , SUM , P ( JP, JM ) 

1004 FORMAT ( 1 OX , E 1 6. 9 , 10 X, E 1 6 . 9, 1 OX , E 1 6 . 9, 1 OX , F4 . 0 , 5X , F4 . 0, 1 OX , E9 . 8 // / 

8 CONTINUE 

PRINT 1000,AL,AN,(AK(I,J0),I=1,10) ,SVAR 
1000 FORMAT ( 10X,9HLAMBDA = , F4. 3 , lOX , 4HN = ,F4.0,///7H K1 = ,F4.0,7H 

1 K2 = ,F4.0,7H K3 = ,F4.0,7H K4 = ,F4.0,7H K5 = ,F4.0,7H 

2 ,F4.0,7H K7 = ,F4.0,7H K3 = ,F4.0,7H K9 = ,F4.0,7H KlO= 
3,///10X, 19HSUM OF VARIANCES = ,E16.9////) 

1 CONTINUE 
END 



1 



111 

12i 

1 . 

i: 

1 : 

r 

1 ) 

U 

2i 

2 

2 : 

2 

2 - 

2 

2r 

2' 

2 ( 

29( 



30( 

311 



3i' 

351 

35 



37f 

31 



,F4.0 



40( 

4‘ 

41 

4' 



4! 

4( 
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01 21 66 



10 
1 1 

20 

21 

|22 

30 

31 

32 
UO 

41 

42 

50 

51 

1152 
I 60 

Ui 

loo' 



SUBROUTINE SAMPLE (AN) 
C0MM0N/VARI/AKnC,6) 

DO 100 JA=1 .6 

GO TO n 10, 120, 1 30,1 LO.lSO.l 60) , , 
on 111 K= I , 10 

AK(K, JA ) =• 1 *AN 
GO TO ICO 
DO 121 KA=1,5 
AK{KAj. JA)=.05-:^AN 
DO 122 KA=6,10 
AK(KA,v.A) = . 15^^A)\ 

GO TO 100 
DO 131 KB=1 ,5 
AK(KE,JA) = * 15<-A,\ 
no 132 KB=6,10 
AK(KB,JA)=.05*AN 
GO TO 100 
AK ( 1 , 4) =.5-AN 
DO 141 KC=2,6 
AK(KC,JA) = . UaN 
DO 142 KC=7,10 
AK (KC y JA ) = .05-AN 
GO TO 100 
DC 151 KD=1,4 
AK(KD,JA}=o05'->AN 
AK{5,5) = o3^-A.^ 

DO 152 K0=6 v‘. 0 
AK(KD, JA)=. 1*AM 
GO TO 100 
AK( 1 t 6) = ,3^-A.M 
DO I6l KE=3,6 
A1<(KE, JA) = « I'-^AA; 

AK { 7t 6 ) = •03*AN 
.02*AN 
Cn\’TINU£ 

RETURN 
END 



AK (2 v 6 ) = . 2 *Ai\ 



AK ( 5 , 6 / =. 03 *AX 



AK( 9 , 6 )=. 02 *AN SAK( 1 C, 6 )= 



10 

3 C 
40 
50 
60 
70 
30 
90 
1 00 
1 1 C 
120 
130 
1 40 
15 C 
16 C 
170 
1 80 

1 90 
200 
210 
220 
230 
240 

2 50 
260 
27 C 
280 
290 
3 CC 
31 C 
320 
330 
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IT( 12) ,LAfi2L(6) 
Cf y; ':\/vA2c‘i/AK( iv ,6 ) 
a2lct= i... 

LA‘JlL(1)=AH 1 
L V [i ^ L ( 2 ) = ii H 2 
L/22L{i)=Uh 3 

LAy£L(U)=Uh 4 
L/.dLL(5)=-H 5 

LA6LL(6)=i^H c 
DC _Cvl i\CN = l,3 
G,'- TC (2CC5,20M ,2C^5) ,\0.\ 
CP = ,7 

GC: iC. 20 C 6 
4 CP=.G 

GC TC 2006 
zGCo C?=,9 

GC TO 2jj6 
2CC6 DC :.3 PI = 1,0 

GC TC (7,8,9) I 
7 A \ = _ 0 r 

C;LL sample (AD) 

GC ro 4C01 
G A r . = ' 0 C 

Ctll SADPLE(AD) 

GC TO 4 '.01 
9 Ai\'=i-0G 

CALL SADPLE(AN) 

r n -r n 



112 IT(n=Sl- 

IT( 7 )= 8 hP( 0 ) = 

IT( 8 )=ICCDE (C'^) 

IT(iu)=cHD = 

ITdl ) = ICfDE (AD) 

IT( ; )= 8 hSUM OF V 
IT( 2 )= 8 }-APIA)DCES 
IT (i)= 6 H VS A 
IT(^)= 8 h (DAVE S 
IT (d) = 8 hTADF 0 RC) 

DC 100 J= 1 , t 

C/'LL PLOT (CP, J, XON, DEWPLuT , IT, LAS EL) 

133 CCMTIDUE 
DEWPLGT=1C 
15 CC.DTIDUE 
20C‘i CCNTIAUE 
E^■D 



no 



- \:'v,?LQT, IT, ) 



r.Ly\rjUTl,\ : j,: 

,L-.rLf6) ,P.\C( i ,••'.) ,SVAR( C 0 ) ,VAR( ;0) 

,.),sv;,P2c. c, 2 ) 

rc n.C0,i V::,':^u) ,MC\ 

IJ. J L v = -,.'-- 

H' (..- I ) IIG, : i ;G 

IZ 'J PAC( : ) = . j u.'i. 

3C TC 

1 iG P/C( .)=PAC(r') + , 

GC TG 4.._P 
4uvOG Gf G-,. IP = l,l:. 

FIP^I P 

2j p( 1P) = ^CP-.G 1 .r.GxPF{ PIP«-paC{ .N ) ) 

T n 1 j 2 

ic: COMI.NUE 
GC TC 

luGG ..c I ]( 1 i\=; , 1 -c 



i C4 


* / i 

p;.C( 1 


! ; 1 i ^ , i . 4 , , . 

} =.C04-^^ 




, j r, ; 3 


^ ' , 
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PAC( 


) =PAC(K) +.C^.^A 




GC TC 


4 2 CG 


1 V '. 


or i\ 1 r 


2U.- 




GO FO 


! lOG 


0C4 


• )C ;. o 


1 K = 1,1 : 




'ir (0- 


:)tli‘F 27 1C-i-,^1Jw 


U 4 


P;.C ( ; 


) = . GuAa9 




G { i .2 


L' ^ r 


1 22 


P4C : 0 


)=PAC(y) 




Zi T V. 


V' C 


101 


cr \T i; 


\ ijZ . 




GO TO 




1G2 


C C .4 


! ‘;<K=1 7 1 ■. 




F K. K = k: 







t. S - /•. 


K(KK 


^ J ) 


"J ( 


A ' 


















LS2 = 




( .< 


i\ 7 J 


) 


K ( N K 7 o 


}-i . ; 


%-p 


( K 


K) 


■X 


2 


^4S 




u F = 




K ( 


‘.<Ky 


J ) -- ( 


'1 .< ( .< K 7 


J } - ■ . 


)•-• 


{ 


K{ 


KK 


t J 


)-2 




L 2 4 = 


A !\ 


{ c 


K r J 


) - ( ' 


•\ ( K iK 7 J 


} 


-x-( AK(K 


i<7 


J ) 




1 


+ 6. 


■Tt E 


S - 


- *1 


i . i_ 


S 2 + c 


. *E S 
















ESS 


- 


Al' 


(KK 


7 0 ) •"• 


( *2< (KK 


f J ) - 1 


. ) 




AK 


(KK 


» J) 


1 


( 


KK 


f G 


} - 4 


. ) - P 


{KK)-w 


3 -r 1 


G . 


* 2 


S-r 


- 


3 S 


. -SJ- - 




L-5.6 


= 


A i\ 


(.:k 


7 J ) ■“.• 


( AK (KK 


7 J)-l 


.) 


*^^(AK 


/ 


KK 


7 jT 


1 


)~4 


. ) 




AK( 


KK^ J 


) — r ■ . } '»• 


P ( K K ) 


ifii 


0 


T i 


^ • 


* i_ 


S5- 


2 


-274 . 


-«• ~ 


S2 


~ 1 2 G 


. w E S 


















OF NO 


V = 


AK 


( KK 


7 J ) * 


C P 


















GPL 


= LCG 


F (C 


p/. :■ 


^ } 


















EC = ( 


1 ^ 


/ F K K 


CPl 


- 1 * / rKKii- ( ‘ . 


/O 


L \ 


r, 




S 


+ 1 . 


1 




/ { 


A • 


MTE 




- 2 ) E S 




9 














EC2 = 


1 * 


/F 


KK<^<2- { 


C P L * 


-?. . *2 


P^ 


•> ( 


1 . 


/D 


£ M 


cc- 


1 


■*■1 . 


/ ( 


3 . 


F' 2 


' 1 ’•' w 




3 ) 1 


,/(C 


E -s 


CV 


X- X 


2 ) 


A 


*EG 


5 


+ 


1 T . 


/T "2 


.--•CEKC 


:•■>*-. ) 




S4 


■i- 


1 . 


/{ 





) * ( A K { K K 7 J 
-‘“-aS:5 u. <■:; S2-. 
-2. )*(AK(K.<7. 
:5.iJ_S4+2^5.^ 



■i.*u 
; . ) *.■ 

) -5 . 

4 , 

2S2 



+ * / ( 2 . '»• G 1 1\ C i‘ 
;+ . . / {D2.\GP,w*5) 
;O.Xic-*5}«-ES5 



S2-2. ^5S 
{;<;<)«• *4 , 

)« ( 

s 

) { AK ( KK 



' *- * 2 ) * E S - 
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0^ C3 



./(^.*DL.'iUr*<C)-^cS6) 

7Ai^-£:C2-c.C 

I r (KK-1 ) 13 1,13^,131 



A 3 S /AR 


( ) = VAR 




OF T 


u 1 4 1 




■1 S7A\ 


{ \ ) = s 


VA^(\) +VAR 


Al cr\T 


I.VJE 




GC TCi ( ICC , 


1" 1,2^01 ) 


00 IF(C 


l'aPLCT- 


10 ) i ,2, 1 



2 r'U-:.vPLCT = c 
1 1 = . 

12DCUPV- 1 
,\UP.PTS= IOC 
KCUi\T = l 
GC rc 3 
1 iVrCCURV = 2 

NUPPTS = NU:-‘PTS-1 
KQL!:\T=KCUNT + 1 
IF(KCUNT-2 ) iOl , i C9,10'i 
1 c- 1 I r ( i< 0 U T - 5 ) K 6 , < C 9 , 1 0 6 
1C9 11=11+1 

no 1 oc 1 = 1,1 uo 

PAc::( I, I i)=pAC(i ) 

1 • 2 SVA22 =SVAR ( I ) 

GC TC 

1C6 IF (KCUMT-6)3,5,3 
5 ,'^CuCURV = 3 

■ 3 CALL CRA'/J(NUiMPTS,PAC, SVAR,KDDCURV,0,LAB£L(KOUNT) , IT,o,0, 

i0,u,^‘,0, / ,9,1, LAST) 

I F (KOLiMT-6 )20F,2:i ,200 
201 rUjMPTS =100 

, C;.LL, CRAl:W.\b?:'PTS , PAC2( 1 , l l ,S VAR<. { 1 , 1 ) , *! ,«. r LAb.iL{ 2) ,I T,0,u, 
/ »9, 1 ,LaST) 

CALL LiRAh( MUiVPTS ,PAC2 ( 1 , 2 ) ,S VAR^ (1 , 2 ) , 5 , C , LABEL ( 3 ) , I T, C , C , 
10,0,0,0,7,9,1 ,LAST) 

200 e.‘:d 
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^ e ‘...Ti-.-. 


(A.J 




■••/VA- u‘/Ai<( ■ 

or ' 


j 0 ) 




c r ” ( 1 ' , ‘ ^ 




■l . , 


' r - ' ' y ~ ~ ^ ‘ ^ 


. » 1 - j 


1 i 1 


55 ^ » 6 A ) - • 1 4 1 » 




1 2 ^ 


t / >. ' ^ 1 * < ^ 




12 ! 


i.r .<A = o,' 




i::i 


r < ( ^ , J . ) = . 1 - <-A^i 

p T ^ 




1 -:o 


1 J 

2 ■ • ::. i / > = 1 , : 




lil 








0^ 1 ::^ KO=o,l'^ 




i .:2 


A/ ( 'T , ) = . .oii- AN 

G5 2', 1'-. 




1 A'J 


AN ( , 






r.n •.<-■. :<c = A,^ 




1 A I 


' ( AC T J ) = , 1 * A.\ 






2' ><C = 7,_ • 




U2 


/A < ( •< C 7 J .' ) = . u 5 * A .\ 

or rc i: 




150 


LC 1 4 ' I<r;=l,i- 




151 


A 2 ( .A 2 T J -'■ } = c 5 * A N 
A/ (r>, 5 } = . :-aN 
f)C/ . ‘j 2 \ 0 = 6 f 1 C 




1 52 


AN { K L) r J A ) = . i »“• A \ 

Gc in u.. 




160 


AG { . 7 6 ) = .:-=^A‘-l 

cr 161 :<5 = 3 t 6 


AK ( :. 


161 


A,C( JA) = . 

a;<c^ 7 c) = .c5-As : 


AK (c 




' '' 




ico' 


' crATT\L: 





R: TLR\ 



AK ( 9 , 6 ) = . Ai\ 



i;ak ( I 0,0 ) = 
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02 0. 



0IMEJSIC.\ IK j2) ,LABEL(6) 
C0MK0N/VaRE1/AK( 10,6) 

N£'/iPLOT=:c 
LA22Ln)=AH 1 
LABcL(2)=AH 2 
LAetL(5)=i’H 3 
LAB2L{U)=iiH 4 
LABhL(5)=4H 5 
LAB£L(6)=^H 6 

DO 2001 N0N=1,3 
GO UJ (2003,2004,2005) ,N0.2 

2003 CP=*7 

GO TO 2006 

2004 CP=.8 

GO TO 2006 

2005 CP=.9 

GO TO 2006 

2006 DO 13 M[=l ,3 

GO TO (7,C,9) ,MI 

7 AN=200 

CALL SA;^PL£(AM) 

GO TO 4001 

8 AN=:i<OG 

CALL SA.MPL£(A\) 

GO TO 40 Jl 

9 Ai\ = 400 

CALL SA;^PL£(AN) 

GO TO 4001 
4001 DO 112 1=1,12 
112 IT(I )=8H 

IT(7)=8H?(0) = 

IT(8)=IC0DE (CP) 

IT(1C)=8HN = 

ITni) = ICODE (A4) 

IT(i )=SHSUM OF V 
IT(2 ) =8HARI A.NCES 
IT(3)=8H VS A 
IT(^-)^-8H (OAVF S 
lT(::^)=bHrANFDRD} 

DO 135 J = 1 ,0 

CALL PLOT (CP, J,NON,NEWPLOT, IT ,LABEL ) 
153 CCMTINU2 
NEWPL0T=10 
13 COMTIMUE 
^Gul CONTINUE 
END 
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o:- j2 



J.-ON,N;w?LOT.IT.LAd£U 

r^fj TPi I i i tf I l-.l•.^ly_ * 



GO TG { I'jv^^vi' / uz 
i>! = l,'iOJ 

1 1 0 , 1 2 0 , r, 0 

.0i07 .!: GC T 

AC * /i ) + • C C v-’T 

'^C='l , 1 0 



1000 


00 loG ; 
M = N-1 
IF C.-l ) 


120 


PAC( 1 ) = 


1 10 


PAC{M)--=, 


102 


on ,4’i ' 
Fr.c=\c 

VAi<( GO ^ 
I F (JO-1 


140 


GVAJ [\)-- 


1 30 


SVAP. ( ,G) : 


141 


cnjTi jui 


lOJ 


CC.MTI fsICi 
or TO 1 


10C2 


DC liCl 
K = J- 1 
IF{J-1 ) 


1104 


p;.C( 1 ) = 


1 1C2 


PAC(l\)=, 


1 106 


DC 1110 
FKQ=JO 
VAR( NO) • 
IF( :o-i 


1 1 14 


SVAR(.\')^ 


1112 


6VAR (Ni 


1110 


CCMTINUi 


1101 


CCNl I.NU, 
GO TO 1 


1004 


DO Jl 

K = N- 1 

i r ( 1 ) : 


^104 


P .C( 1 ) = 


^102 


PACdO = ^ 


2106 


GC Alio 
F:\n = JU 
V^.R{ .VO) 
IF (:,0-l 


1114 


SVAG(G. ) 


2112 


SVAR{ ) 


^ 1 1 0 


CC.NTI \'U, 


2101 


CONTINU: 
Gf. TO 1 


1100 


Ir i:\ZV.? 




NlNPLOT 
I I =.. 

hCDCORV 
.v'UMPTS = 
KC0.JT = 1 
GO TO 3 


1 


CCDCURV 
iN U M P T S - 



lo: 



) ---F^iOi^*2)«(C?~PAC(.N)^FNO}«-( 1 .~CP+?AC(N)^FNC 
GO TO 141 



1 1 j 2 » 1 1 •; 4 , 1 ] 02 
0G05 . GC TO 11C6 

' A C { >' ) + « 0 ' ’3 C 5 
KO = 1,10 



10 



i •' 2 , 2 I 0^^ . 2 1 . 2 

•^0 9 j GO 



G< ( G G , j } F.\ 0 * '^2 ) ~ ( u .- 

i ) ’v uG 1 T} ill C 



>AC(N}-FNO)« ( 1 .-C?+PAC(\)*FNO 



.GT-10) 1 ,2i 
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0^ u2 



>'',Cu..T=K 0U"4T+ 1 
IF (KCLM-?) lOi , i (.9, 1 0 1 
, . (:<0U\T-5) Iw6, 1C9,106 

1 O 9 i I = I I -r 1 

IjC i. 4l = 1,1 '0 
PAC_ ( I , I I) =PAC ( 1 ) 

1 G4 SVAR2 ( I , I I) =SVAR (I ) 

GO TG 2v>0 

1C6 IF (KnU..T-6)3,S,3 
5 :-:cocur<v = 3 

3 CAl.L OFA■/,(^JGy.PTS ,PAC , S VAR , MGOC’oRV , 0 , LABCL ( KOUMT ) , IT, 0, 0, 

10.0. 0.0.7.9, , L A S T ) 

IP {;<QUNT-6) 20C ,20 1 ,200 
201 MUMPTS =100 

CALL DRALtNOMPTS ,PAC2( 1, 1 ) ,SVAR2 {1,1),1,0,LABEL{2),IT,0,0, 

10.0. 0.0.7.9.1 , LA ST) 

Call ORAWI.NURPTS , PAC2( l ,2) ,SVAR2 (1,2),3,0,LABEL(5),IT,0,J, 

10.0. 0.0.7.9. 1 vLAST) 

2o0 END 
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SCo. jUTI.'!' SAfPLu (Ar.j 

, /ak( ic ,o ) 
r>n o/-.= i,6. 

^ 9 , f ^ J ^ 'J 7 * A 7 • ^ J i ^ » 1 6 0 ) 7 J A 

1.0 ' ; 0 Ml C 

1 1 ■/ /.A ( Kv JA ) =. ; i:-A\ 

G Gif' ] j v!/ 

IPO DO .21 K A = 1 , 5 
121 A<(K\ , j;) = ,r-5:>AG 



122 


or, 


1 2 .< A = 6 , 0 


/ :< 


C<A, JA) = . ,5-AiM 




GO 


in 1 ■ j 


i 3 T 


0 C ' 

a:< 


Ml '<0=1 y 5 
( .< r", 7 J A ) = * i 5 •"• A X 


132 


DO 


1 i<h = 6, 10 


/■ K 


( K ’ ; vj » ) - • U 0 * A \ 




GC 


TC IJO 


1 AO 


Ai< 


( i J 4 ) = . 3 * AX 




00 


1 4 1 X C = 2 7 6 


1 A 1 


A,< 


(KsC, JM = c m-AX 




I'C 


, 4^ KC=7 ; 1 


1 A2 


;.!< 


( Tv C V J ~ 0 A , s 




GO 


TO 1 , ' 


1 30 


00 


Ml <i.= M4 


1 51 


a;<(kd7J'^)=*. 5 -ax 



1 

160 

161 

100 



..<(>■ 5) = 

00 . 1) A K 0 — 6 7 i ' 

A K ( .< L s J A } = • M A .\ 
GO lO !■.- 
mX(17 6 ) = c?--AM 
GO i5i !\ 2=376 
A;< (K2 V Jm ) = „ l-AG 
AX(7,c) = .03<:AM 
- 02 -AX’ 

CGXTI XUO 

R2TU.^X 

lMD 



AK ( 276 ; = .2 -AX 
AK (876 ) = *j3*A, 



AK(9,6)=. 02-AX 



i» A.< ( 1 0 7 6 
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